Some Approximation Properties of Projection Pursuit Learning Networks
نویسندگان
چکیده
This paper will address an important question in machine learning: What kind of network architectures work better on what kind of problems? A projection pursuit learning network has a very similar structure to a one hidden layer sigmoidal neural network. A general method based on a continuous version of projection pursuit regression is developed to show that projection pursuit regression works better on angular smooth functions than on Laplacian smooth functions. There exists a ridge function approximation scheme to avoid the curse of dimensionality for approximating functions in L2(¢d).
منابع مشابه
On the Use of Projection Pursuit Constraints for Training Neural Networks
\Ve present a novel classifica t.ioll and regression met.hod that combines exploratory projection pursuit. (unsupervised traiuing) with projection pursuit. regression (supervised t.raining), t.o yield a. nev,,' family of cost./complexity penalLy terms . Some improved generalization properties are demonstrat.ed on real \vorld problems.
متن کاملImplementing projection pursuit learning
This paper examines the implementation of projection pursuit regression (PPR) in the context of machine learning and neural networks. We propose a parametric PPR with direct training which achieves improved training speed and accuracy when compared with nonparametric PPR. Analysis and simulations are done for heuristics to choose good initial projection directions. A comparison of a projection ...
متن کاملRegression modeling in back-propagation and projection pursuit learning
We study and compare two types of connectionist learning methods for model-free regression problems: 1) the backpropagation learning (BPL); and 2) the projection pursuit learning (PPL) emerged in recent years in the statistical estimation literature. Both the BPL and the PPL are based on projections of the data in directions determined from interconnection weights. However, unlike the use of fi...
متن کاملImage Compression and Signal Classification by Neural Networks and Projection Pursuits
In this report, two applications of neural networks are investigated. The first one is low bit rate image compression by using neural networks and projection pursuit. The second one is improving the classification accuracy of neural network classifiers by using unlabeled data. In the first part, a novel approach for low bit rate image coding is presented. The image is compressed by first quadtr...
متن کاملLow Bit Rate Image Compression with Orthogonal Projection Pursuit Neural Networks
A new multiresolution algorithm for image compression based on projection pursuit neural networks is presented. High quality low bit-rate image compression is achieved first by segmenting an image into regions of different sizes based on perceptual variation in each region and then constructing a distinct code for each block by using the orthogonal projection pursuit neural networks. This algor...
متن کامل